Timeline for multi-image viewer

ABSTRACT

The systems, methods, and GUIs of the present invention not only have the ability to display DICOM and non-DICOM images simultaneously, side-by-side in a single viewer, but also display a timeline corresponding to more than one healthcare study. A selection of more than one healthcare study from different sources, without requiring a single storage repository or single PACS system, is received and a viewer is launched for the selected studies. Any DICOM images are converted to a non-DICOM format such that non-DICOM images from the more than one healthcare study side-by-side in the viewer. A timeline corresponding to more than one healthcare study for a patient is provided. From the timeline, images from different sources can be selected and displayed side-by-side in the viewer in a non-DICOM format.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is related to commonly assigned U.S. PatentApplications entitled “Multi-Image Viewer for Multi-Sourced Images”13/285,847 filed concurrently herewith on the same date.

BACKGROUND

Oftentimes in a healthcare environment, it is necessary to captureimages of a patient. These images can include radiology images,laboratory images, pictures, cardiology images and a variety of otherimages. These images can be captured electronically in a variety of waysand are used for treatment of the patient. Patient information, such asreports for the images, may also be entered and recorded in a health (orclinical) information system.

While patient information is stored in a clinical information system,the captured images are stored in an archive. Picture archiving andcommunication systems (PACS) are exemplary digital archives for storinghealthcare images, reports, and videos. The captured healthcare imagesmay be stored in a variety of formats including DICOM (Digital Imagingand Communications in Medicine) and non-DICOM objects in native format.In addition, the captured healthcare images are often stored in avariety of locations, depending on the format.

DICOM images are archived according to specific standards for storing,transmitting and handling information in medical imaging. The standardsinclude file format definition and network communications protocol.DICOM groups images together with information such as patientidentification so each image is not mistakenly separated from thepatient identification. Non-DICOM healthcare images do not adhere to thespecific DICOM standards.

Currently, although PACS digital archives can store DICOM, non-DICOMobjects in native format, and other storage options, the image viewersto view DICOM and non-DICOM images are separate and DICOM and non-DICOMimages cannot be viewed side-by-side within the same viewer. Further,the DICOM and non-DICOM images cannot be accessed from the patient'selectronic medical record (EMR). Still further, a clinician is unable toaccess and view a history of different studies and other clinical imagesfrom inside the viewer, making it difficult to understand the entireclinical story associated with the patient.

SUMMARY

This summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used as an aid in determining the scope of the claimed subjectmatter.

In one embodiment, one or more computer storage media storingcomputer-useable instructions that, when executed by one or morecomputing devices, cause the one or more computing devices to perform amethod for displaying at least one DICOM and at least one non-DICOMhealthcare image for a patient simultaneously. The method comprises,from an electronic medical record, receiving a selection of more thanone healthcare study from different sources. The method furthercomprises launching a viewer for selected studies. The method furthercomprises determining a healthcare image type for the more than onehealthcare study. The method further comprises converting any DICOMimages to Joint Photographic Experts Group (JPEG) format. The methodfurther comprises displaying non-DICOM images from the more than onehealthcare study side-by-side in the viewer.

In another embodiment, a computer system for displaying at least oneDICOM and at least one non-DICOM healthcare image for a patientsimultaneously is provided. The computer system comprises a processorcoupled to a computer storage medium, the computer storage medium havingstored thereon a plurality of computer software components executable bythe processor. The computer software components comprise a selectioncomponent for receiving selection of more than one healthcare study fromdifferent sources. The computer software components further comprise aviewer component for launching a viewer for the selected studies. Thecomputer software components further comprise a determination componentfor determining a healthcare image type for the more than one healthcarestudy. The computer software components further comprise a conversioncomponent for converting DICOM images to JPEG format. The computersoftware components further comprise a display component for displayingthe more than one healthcare image from the more than one healthcarestudy side-by-side in the viewer and in a non-DICOM format.

In another embodiment, a graphical user interface (GUI) embodied on oneor more computer storage medium and executable by a computing device isprovided. The GUI comprises a first display area for displaying a listof available multimedia files from more than one source. The GUI furthercomprises a second display area for displaying selected multimedia filesin a non-DICOM format. The GUI further comprises a third display areafor displaying other images associated with the selected multimediafiles. The GUI further comprises a fourth display area for displayingadditional information associated with the selected multimedia files.

In another embodiment, one or more computer storage media storingcomputer-useable instructions that, when executed by one or morecomputing devices, cause the one or more computing devices to perform amethod for displaying a timeline corresponding to more than onehealthcare study. The method comprises presenting a timelinecorresponding to more than one healthcare study for a patient. Themethod further comprises receiving a selection, from the timeline, of atleast one DICOM and at least one non-DICOM healthcare image source fromdifferent sources. The method further comprises launching a viewer forthe selected healthcare images. The method further comprises displayingthe selected healthcare images side-by-side in the viewer and in anon-DICOM format.

In another embodiment, a computer system for displaying at least oneDICOM and at least one non-DICOM healthcare image is provided. Thecomputer system comprises a processor coupled to a computer storagemedium, the computer storage medium having stored thereon a plurality ofcomputer software components executable by the processor. The computersoftware components comprise a timeline component for presenting atimeline corresponding to more than one healthcare study for a patient.The computer software components further comprise a selection componentfor receiving, from the timeline, a selection of more than onehealthcare image sourced from different sources. The computer softwarecomponents further comprise a viewer component for launching a viewerfor the selected studies. The computer software components furthercomprise a display component for displaying the more than one healthcareimage from the more than one healthcare study side-by-side in the viewerand in a non-DICOM format.

In another embodiment, a graphical user interface (GUI) embodied on oneor more computer storage medium and executable by a computing device isprovided. The GUI comprises a first display area for displaying atimeline corresponding to more than one healthcare study from more thanone source. The GUI further comprises a second display area fordisplaying selected multimedia files in a non-DICOM format. The GUIfurther comprises a third display area for displaying additionalinformation associated with the selected multimedia files.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The present invention is described in detail below with reference to theattached drawing figures, wherein:

FIG. 1 is a block diagram of an exemplary computing environment suitablefor use in implementing embodiments of the present invention;

FIG. 2 is an exemplary system architecture suitable for use inimplementing embodiments of the present invention;

FIG. 3 is an exemplary system architecture suitable for use inimplementing embodiments of the present invention;

FIG. 4 is an exemplary screen displaying a list of available multimediafiles from more than one source in accordance with an embodiment of thepresent invention;

FIG. 5 is an exemplary screen displaying selected multimedia files frommore than one source in a non-DICOM format in accordance with anembodiment of the present invention;

FIG. 6 is an exemplary screen displaying a timeline corresponding tomore than one healthcare study from more than one source in accordancewith an embodiment of the present invention;

FIG. 7 is a flow diagram illustrating a method for displaying at leastone DICOM and at least one non-DICOM healthcare image for a patientsimultaneously in accordance with an embodiment of the presentinvention; and

FIG. 8 is a flow diagram illustrating a method for displaying a timelinecorresponding to more than one healthcare study in accordance with anembodiment of the present invention.

DETAILED DESCRIPTION

Embodiments of the present invention are directed to systems, methods,and GUIs for displaying at least one DICOM and at least one non-DICOMhealthcare image for a patient simultaneously. Embodiments of thepresent invention are also directed to systems, methods, and GUIs fordisplaying a timeline corresponding to more than one healthcare study.The systems, methods, and GUIs of the present invention not only havethe ability to display DICOM and non-DICOM images simultaneously,side-by-side in a single viewer, but also display a timelinecorresponding to more than one healthcare study. Having brieflydescribed an overview of the present invention, embodiments of theinvention will be discussed with reference to FIGS. 1-8.

The subject matter of the present invention is described withspecificity herein to meet statutory requirements. However, thedescription itself is not intended to limit the scope of this patent.Rather, the inventors have contemplated that the claimed subject mattermight also be embodied in other ways, to include different steps orcombinations of steps similar to the ones described in this document, inconjunction with other present or future technologies.

Having briefly described embodiments of the present invention, anexemplary operating environment suitable for use in implementingembodiments of the present invention is described below.

Referring to the drawings in general, and initially to FIG. 1 inparticular, an exemplary computing system environment, a medicalinformation computing system environment, with which embodiments of thepresent invention may be implemented is illustrated and designatedgenerally as reference numeral 20. It will be understood and appreciatedby those of ordinary skill in the art that the illustrated medicalinformation computing system environment 20 is merely an example of onesuitable computing environment and is not intended to suggest anylimitation as to the scope of use or functionality of the invention.Neither should the medical information computing system environment 20be interpreted as having any dependency or requirement relating to anysingle component or combination of components illustrated therein.

The present invention may be operational with numerous other generalpurpose or special purpose computing system environments orconfigurations. Examples of well-known computing systems, environments,and/or configurations that may be suitable for use with the presentinvention include, by way of example only, personal computers, servercomputers, handheld or laptop devices, multiprocessor systems,microprocessor-based systems, set top boxes, programmable consumerelectronics, network PCs, minicomputers, mainframe computers,distributed computing environments that include any of theabove-mentioned systems or devices, and the like.

The present invention may be described in the general context ofcomputer-executable instructions, such as program modules, beingexecuted by a computer. Generally, program modules include, but are notlimited to, routines, programs, objects, components, and data structuresthat perform particular tasks or implement particular abstract datatypes. The present invention may also be practiced in distributedcomputing environments where tasks are performed by remote processingdevices that are linked through a communications network. In adistributed computing environment, program modules may be located inassociation with local and/or remote computer storage media including,by way of example only, memory storage devices.

With continued reference to FIG. 1, the exemplary medical informationcomputing system environment 20 includes a general purpose computingdevice in the form of a control server 22. Components of the controlserver 22 may include, without limitation, a processing unit, internalsystem memory, and a suitable system bus for coupling various systemcomponents, including database cluster 24, with the control server 22.The system bus may be any of several types of bus structures, includinga memory bus or memory controller, a peripheral bus, and a local bus,using any of a variety of bus architectures. By way of example, and notlimitation, such architectures include Industry Standard Architecture(ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA)bus, Video Electronic Standards Association (VESA) local bus, andPeripheral Component Interconnect (PCI) bus, also known as Mezzaninebus.

The control server 22 typically includes therein, or has access to, avariety of computer-readable media, for instance, database cluster 24.Computer-readable media can be any available media that may be accessedby server 22, and includes volatile and nonvolatile media, as well asremovable and non-removable media. By way of example, and notlimitation, computer-readable media may include computer storage media.Computer storage media may include, without limitation, volatile andnonvolatile media, as well as removable and non-removable mediaimplemented in any method or technology for storage of information, suchas computer-readable instructions, data structures, program modules, orother data. In this regard, computer storage media may include, but isnot limited to, RAM, ROM, EEPROM, flash memory or other memorytechnology, CD-ROM, digital versatile disks (DVDs) or other optical diskstorage, magnetic cassettes, magnetic tape, magnetic disk storage, orother magnetic storage device, or any other medium which can be used tostore the desired information and which may be accessed by the controlserver 22. By way of example, and not limitation, communication mediaincludes wired media such as a wired network or direct-wired connection,and wireless media such as acoustic, RF, infrared, and other wirelessmedia. Combinations of any of the above also may be included within thescope of computer-readable media.

The computer storage media discussed above and illustrated in FIG. 1,including database cluster 24, provide storage of computer-readableinstructions, data structures, program modules, and other data for thecontrol server 22. The control server 22 may operate in a computernetwork 26 using logical connections to one or more remote computers 28.Remote computers 28 may be located at a variety of locations in amedical or research environment, for example, but not limited to,clinical laboratories (e.g., molecular diagnostic laboratories),hospitals and other inpatient settings, veterinary environments,ambulatory settings, medical billing and financial offices, hospitaladministration settings, home health care environments, and clinicians'offices. Clinicians may include, but are not limited to, a treatingphysician or physicians, specialists such as intensivists, surgeons,radiologists, cardiologists, and oncologists, emergency medicaltechnicians, physicians' assistants, nurse practitioners, nurses,nurses' aides, pharmacists, dieticians, microbiologists, laboratoryexperts, laboratory technologists, genetic counselors, researchers,veterinarians, students, and the like. The remote computers 28 may alsobe physically located in non-traditional medical care environments sothat the entire health care community may be capable of integration onthe network. The remote computers 28 may be personal computers, servers,routers, network PCs, peer devices, other common network nodes, or thelike, and may include some or all of the elements described above inrelation to the control server 22. The devices can be personal digitalassistants or other like devices.

Exemplary computer networks 26 may include, without limitation, localarea networks (LANs) and/or wide area networks (WANs). Such networkingenvironments are commonplace in offices, enterprise-wide computernetworks, intranets, and the Internet. When utilized in a WAN networkingenvironment, the control server 22 may include a modem or other meansfor establishing communications over the WAN, such as the Internet. In anetworked environment, program modules or portions thereof may be storedin association with the control server 22, the database cluster 24, orany of the remote computers 28. For example, and not by way oflimitation, various application programs may reside on the memoryassociated with any one or more of the remote computers 28. It will beappreciated by those of ordinary skill in the art that the networkconnections shown are exemplary and other means of establishing acommunications link between the computers (e.g., control server 22 andremote computers 28) may be utilized.

In operation, a clinician may enter commands and information into thecontrol server 22 or convey the commands and information to the controlserver 22 via one or more of the remote computers 28 through inputdevices, such as a keyboard, a pointing device (commonly referred to asa mouse), a trackball, or a touch pad. Other input devices may include,without limitation, microphones, satellite dishes, scanners, or thelike. Commands and information may also be sent directly from a remotehealthcare device to the control server 22. In addition to a monitor,the control server 22 and/or remote computers 28 may include otherperipheral output devices, such as speakers and a printer.

Although many other internal components of the control server 22 and theremote computers 28 are not shown, those of ordinary skill in the artwill appreciate that such components and their interconnection are wellknown. Accordingly, additional details concerning the internalconstruction of the control server 22 and the remote computers 28 arenot further disclosed herein.

With reference to FIG. 2, a block diagram is illustrated that shows anexemplary computing system architecture for displaying at least oneDICOM and at least one non-DICOM healthcare image for a patientsimultaneously. It will be appreciated that the computing systemarchitecture shown in FIG. 2 is merely an example of one suitablecomputing system and is not intended as having any dependency orrequirement related to any single module/component or combination ofmodules/components.

The computing system includes a multi-image viewer module 210 and one ormore databases 230, 240, storing and maintaining non-DICOM and DICOMimages. Exemplary non-DICOM and DICOM images include radiology images,laboratory images, pictures, cardiology images, such as ECHO images, andother medical images. One of skill in the art will appreciate that thedatabases may be maintained separately or may be integrated. Databases230, 240 may contain images that are linked to a patient's electronicmedical record (EMR), such that images may be selected from within theEMR and launched and displayed within a single viewer via themulti-image viewer module 210. As utilized herein, the acronym “EMR” isnot meant to be limiting, and may broadly refer to any or all aspects ofthe patient's medical record rendered in a digital format. Generally,the EMR is supported by systems configured to co-ordinate the storageand retrieval of individual records with the aid of computing devices.As such, a variety of types of healthcare-related information may bestored and accessed in this way. By way of example, the EMR may storeone or more of the following types of information: patient demographic;medical history (e.g., examination and progress reports of health andillnesses); medicine and allergy lists/immunization status; laboratorytest results, radiology images (e.g., X-rays, CTs, MRIs, etc.); otherimages; evidence-based recommendations for specific medical conditions;a record of appointments and physician's notes; billing records; anddata received from an associated medical device. Accordingly, systemsthat employ EMRs reduce medical errors, increase physician efficiency,and reduce costs, as well as promote standardization of healthcare.Graphical display device 220 may be a monitor, computer screen, projectdevice or other hardware device for displaying output capable ofdisplaying graphical user interfaces.

Multi-image viewer module 210 receives and displays images that aresourced from more than one source, or database. Thus, a single storagerepository or a single PACS system is not required. Multi-image viewermodule 210 may reside on one or more computing devices, such as, forexample, the control server 22 described above with reference to FIG. 1.By way of example, the control server 22 includes a computer processorand may be a server, personal computer, desktop computer, laptopcomputer, handheld device, mobile device, consumer electronic device, orthe like.

Multi-image viewer module 210 comprises selection component 212, viewercomponent 214, determination component 216, conversion component 218,and display component 220. In various embodiments, multi-image viewermodule 210 includes a history component 222, an information component224, and a manipulation component 226. It will be appreciated that whilemulti-image viewer module 210 is depicted as receiving healthcare imagesfrom a single non-DICOM database 230 and a single DICOM database 240,multi-image viewer module 210 may receive healthcare images frommultiple non-DICOM, DICOM, and/or mixed sources including databasesspread across multiple facilities and/or multiple locations. It willalso be appreciated that multi-image viewer module 210 may receiveshealthcare images from the sources described above via links within apatient's EMR.

The selection component 212 receives a selection of more than onehealthcare study. A healthcare study comprises one or more series. Forexample, the healthcare study may contain a series of images withvarying degrees of contrast or a series of images without contrast. Eachseries comprises one or more images depicting the subject of the imagefrom various angles. A list perspective within a multimedia managerprovides a list of available studies, images, and other media. Aclinician can select the desired items to launch in the viewer. In oneembodiment, the selection of desired items may be made within the EMR.

Once the selection component 212 receives the clinician's selection, theviewer component 214 launches the viewer for the selected studies. Thedetermination component 216 determines a healthcare image type for themore than one healthcare study. That is, the determination component 216determines whether the healthcare images for each selected study isDICOM or non-DICOM. Any DICOM images are converted to JPEG format by theconversion component 218. This conversion allows non-DICOM and DICOMimages to be rendered side-by-side within the same viewer, without DICOMwrapping the non-DICOM images. The display component 220 displays themore than one healthcare study side-by-side in the viewer and in anon-DICOM format.

In one embodiment, a history component 222 displays a history ofdifferent studies and clinical images associated with the more than onehealthcare image. The history component 222 further allows a selectionof one or more images from the history to be displayed in the viewer bythe display component 220. For example, the selection component 212 mayhave received a selection from the clinician of a particular study.However, once the display component 220 has displayed the images thatcomprise that selected study, the history component 222 may displayother studies and clinical images that are of particular interest to theclinician. The clinician may then select additional items from thehistory to launch within the viewer.

In one embodiment, an information component 224 displays additionalinformation associated with the more than one healthcare image, thehistory, or a combination thereof. The additional information comprisespatient identifying information, image related information, studyrelated information, or a combination thereof. Such additionalinformation may also include time related information.

In one embodiment, a manipulation component 226 allows a clinician tomanipulate a display of a healthcare image. For example, a clinician maydetermine that the image as it is rendered within the viewer is notlarge enough to see a desired level of detail. The clinician may zoom inor out and the manipulation component 226 manipulates the display of theimage accordingly. Similarly, the clinician may desire to pan an imageand the manipulation component 226 manipulates the image displayaccordingly.

With reference to FIG. 3, a block diagram is illustrated that shows anexemplary computing system architecture for displaying a timelinecorresponding to more than one healthcare study. It will be appreciatedthat the computing system architecture shown in FIG. 2 is merely anexample of one suitable computing system and is not intended as havingany dependency or requirement related to any single module/component orcombination of modules/components.

The computing system includes a historical module 310 and one or moredatabases 330, 340, storing and maintaining non-DICOM and DICOM images.As noted above, exemplary non-DICOM and DICOM images include radiologyimages, laboratory images, pictures, cardiology images, such as ECHOimages, and other medical images. One of skill in the art willappreciate that the databases may be maintained separately or may beintegrated. Databases 330, 340 may contain images that are linked to apatient's electronic medical record (EMR), such that images may beordered and displayed in a timeline via the historical module 310.

Historical module 310 receives and displays within in a timeline imagesthat are sourced from more than one source, or database. Historicalmodule 210 may reside on one or more computing devices, such as, forexample, the control server 22 described above with reference to FIG. 1.By way of example, the control server 22 includes a computer processorand may be a server, personal computer, desktop computer, laptopcomputer, handheld device, mobile device, consumer electronic device, orthe like.

Historical module 310 comprises timeline component 312, historicalselection component 314, historical viewer component 316, and ahistorical display component 318. In various embodiments, historicalmodule 310 includes a historical detail component 320, a resolutioncomponent 322, a thumbnail component 324, and a historical informationcomponent 326. It will be appreciated that while historical module 310is depicted as receiving healthcare images from a single non-DICOMdatabase 330 and a single DICOM database 340, historical module 310 mayreceive healthcare images from multiple non-DICOM, DICOM, and/or mixedsources including databases spread across multiple facilities and/ormultiple locations. It will also be appreciated that historical module310 may include or incorporate any of the components described abovewith respect to the multi-image viewer module 210. Similarly, it will beappreciated that the multi-image viewer module 210 may include orincorporate any of the components described above with respect to thehistorical module 310.

The timeline component 312 presents a timeline corresponding to morethan one healthcare study for a patient. For example, after theselection component 212 of the multi-image viewer module 210 receives aselection of more than one healthcare study, the timeline componentpresents the more than one healthcare study in a timeline. The timelineprovides the clinician context for the patient history. Similarly, inone embodiment, the history component 222 of the multi-image viewermodule 210 displays other studies and clinical images that are ofparticular interest to the clinician. These other studies and clinicalimages are also arranged within the timeline. In one embodiment, athumbnail component 324 displays at least one thumbnail of an imagecorresponding to the more than one healthcare study of the timeline. Thethumbnails provide a high level view of the image for the event on thetimeline to provide a visual of the events associated with the timeline.

A historical selection component 314 receives, from the timeline, aselection of more than one healthcare image sourced from differentsources. As described above, the selection includes at least onenon-DICOM and one DICOM healthcare image. A historical viewer component316 launches a viewer for the selected images. A historical displaycomponent 318 displays the more than one healthcare image from the morethan one healthcare study side-by-side in the viewer and in a non-DICOMformat. As described above, any DICOM images are converted to anon-DICOM format, such as JPEG, prior to being displayed by thehistorical display component 318 within the viewer.

In one embodiment, a historical detail component 320 expands andcollapses the timeline to display a level of granularity correspondingto the more than one healthcare study as desired by a clinician. Forexample, the clinician may desire to see all images associated with agiven healthcare study or all images associated with all the healthcarestudies appearing on the timeline. The clinician may double click on ahealthcare study on the timeline and the historical detail component 320expands the timeline allowing the clinician to see each image associatedwith the healthcare study. Or the clinician may indicate, such as with atool or selecting an appropriate setting, to the historical detailcomponent 320 that the clinician desires to expand the timeline to seeall images associated with all healthcare studies appearing on thetimeline. Similarly, the clinician may indicate to the historical detailcomponent 320 that the clinician desires to collapse the timeline for aselected healthcare study or for all healthcare studies, such that onlythe healthcare studies appear on the timeline.

In one embodiment, a resolution component 322 retrieves a DICOM versionof an image if a better resolution is desired. For example, theclinician may desire to zoom in on a selected image. The JPEG version ofthe image may not have the resolution necessary for the clinician to seethe desired detail. In this instance, the resolution component retrievesthe DICOM version of the image so the desired detail is available forthe clinician. In one embodiment, a modified JPEG version of the imageis retrieved with the appropriate zoom applied.

In one embodiment, a historical information component 326 includeshistorical information in the timeline. For example, the historicalinformation component 326 may include historical information associatedwith the healthcare studies and images that may be relevant to theclinician. This historical information may include non-image items suchas procedure reports, healthcare related visits, and other informationthat may provide context for the clinician to give the clinician abetter understanding of the images provided in the viewer.

Referring now to FIG. 4, an exemplary screen displaying a list ofavailable multimedia files from more than one source is shown. A firstdisplay area 405 displays a list of available multimedia files from morethan one source. Available multimedia files include continuity of caredocuments 410, clinical attachments 412 (i.e., reports), clinical photos414, dermatology photos 416, DICOM studies 418, endoscopy photos 420,other photos 422, pathology photos 424, patient photos 426, plasticsurgery photos 428, and the like. Information 450 related to theavailable multimedia files when a particular file is selected and athumbnail image 460 is shown as a preview to assist the clinician inselecting the desired files. Once the clinician has selected all thedesired multimedia files, the clinician can selected the show button 430and select current media viewer 440 to display the selected files in asingle viewer, without DICOM wrapping the images.

Referring now to FIG. 5, an exemplary screen selected multimedia filesfrom more than one source in a non-DICOM format is shown. In variousembodiments, the available multimedia files include DICOM and non-DICOMimages; however, at least initially, the images are shown in the viewerin a non-DICOM format. A second display area displays selectedmultimedia files 510, 520 in a non-DICOM format. Thumbnails of images ofthe selected multimedia files are displayed in a third display area 530,along with previous images associated with the selected multimediafiles. The previous images may provide context to a clinician whenviewing the images. For example, the previous images may be related toan injury, such as a burn. The images provide a visual story of thepatient's recovery and progress and assist the clinician in treating thepatient. A fourth display area 512, 514, 522, 524 displays additionalinformation associated with the selected multimedia files for each imagedisplayed by the viewer. The additional information includes patientidentifying information, image type, contrast information, date, time,series number, image number, and the like. In one embodiment, a fifthdisplay area displays pathology reports corresponding to the selectedmultimedia files.

A sixth display area displays tools used for manipulating the selectedmultimedia files. The tools include a single image tool 552 for showinga single image within the viewer, such as might be desired when aclinician desires to see more detail within a specific image. A twoimage tool 554 allows the clinician to see two images side-by-sidewithin the viewer. A three image tool 556 and a four image tool 558allows the clinician to see three or four images, respectively,side-by-side within the viewer. A play tool 560 allows the clinician toplay a video file or play through a series of images associated with aparticular study. A magnification tool 562 allows a clinician to zoom inand out depending on the level of detail needed.

Referring now to FIG. 6, an exemplary screen a timeline corresponding tomore than one healthcare study from more than one source is shown. Afirst display area 640 displays a timeline corresponding to more thanone healthcare study from more than one source. A second display area605 displays selected multimedia files 610, 620 in a non-DICOM format.The multimedia files are, in one embodiment, selected from the timeline.A third display area 636 displays additional information associated withthe selected multimedia files. This timeline related information isinformation related to the timeline as a whole, such as patientidentifying information that is the subject of the timeline. In oneembodiment, a fourth display area displays at least one thumbnail of animage corresponding to the more than one healthcare study on thetimeline. A clinician looking at the thumbnails of the images describedabove with respect to FIG. 5, may click on the timeline button 630 todisplay the timeline view. The Show Studies box 632 can be selected toshow studies on the timeline and by selecting a study from the timeline,the clinician can view the selected study. Similarly, the Show Other box634 can be selected and other items appear on the timeline. By selectingan item from the timeline, the clinician can view the selected item. Forexample, a pathology report may exist for a patient that does notinitially appear on the timeline of multimedia files. Once the clinicianselects the Show Other box 624, the pathology report may appear on thetimeline and is now selectable for viewing inside the viewerside-by-side with the multimedia files. A fifth display area, in oneembodiment, displays a history and other clinical images on thetimeline. For example, other images related to any selected images,including previous images associated with the selected images, aredisplayed on the timeline. Once selected by the clinician, these imagesare rendered inside the viewer along with the selected images. In oneembodiment, a sixth display area 625 displays study information. Thisinformation is related to the study, or image of a study, that isdepicted inside the viewer. Study information comprises patientinformation, study type, procedure, an indication of contrast, or anycombination thereof.

Referring now to FIG. 7, a flow diagram illustrating a method 700 fordisplaying at least one DICOM and at least one non-DICOM healthcareimage for a patient simultaneously is shown. At step 710, a selection ofmore than one healthcare study from different sources is received. Inone embodiment, the more than one healthcare study comprises DICOM andnon-DICOM images. In one embodiment, each study comprises one or moreseries. For example, the study may include a series of images withvarying degrees of contrast or a series of images without contrast. Inone embodiment, each series comprises one or more images. For example,each series comprises one or more images depicting the subject of theimage from various angles.

A viewer is launched, at step 720 for the selected studies. A healthcareimage type is determined for the more than one healthcare study at step730. Any DICOM images are converted, at step 740, to Joint PhotographicExperts Group (JPEG) format. At step 750, the non-DICOM images aredisplayed from the more than one healthcare study side-by-side in theviewer.

In one embodiment, a DICOM version of the images is retrieved if abetter resolution is desired. For example, the clinician may desire tozoom in or out on a particular image. If a level of zoom is desired thatis beyond the capability of the resolution of the image in the viewer,the DICOM version of the image is retrieved allowing the clinician tozoom in for greater detail. In one embodiment, a modified JPEG versionof the image is retrieved with the appropriate zoom applied.

In one embodiment, a history for the patient is provided. In oneembodiment, the history for the patient comprises previous imagesassociated with the more than one healthcare image. In anotherembodiment, the history of the patient includes additional informationassociated with the more than one healthcare image, the previous images,or a combination thereof. In another embodiment, the history for thepatient comprises both the previous images and the additionalinformation. In one embodiment, the additional information comprisesreports, studies, patient information from the electronic medicalrecord, or a combination thereof. The history allows the clinician tobetter understand the context surrounding a given image. In oneembodiment, the history is presented in a predefined order. For example,the predefined order may be according to the time and date associatedwith the history.

In one embodiment, a history of different studies and clinical imagesassociated with the more than one healthcare image is accessed. Forexample, a clinician may be reviewing an x-ray of a patient. Previousx-rays may be associated with the x-ray the clinician is currentlyreviewing. The previous x-rays will also be presented to the clinicianto provide the clinician with a better understanding of the contextsurrounding the x-ray. In this example, the context may inform theclinician that a fracture is or is not healing properly.

In one embodiment, thumbnails are retrieved representing each seriesassociated with the more than one healthcare study. These images arepresented to the clinician and allow the clinician to select specificimages the clinician desires to view within the viewer. These images maybe part of the history described above.

Referring now to FIG. 8, a flow diagram illustrating a method 800 fordisplaying a timeline corresponding to more than one healthcare study isshown. At step 810, a timeline corresponding to more than one healthcarestudy for a patient is presented. In one embodiment, each studycomprises one or more series. In one embodiment, the more than onehealthcare study comprises DICOM and non-DICOM images. In oneembodiment, each study comprises one or more series. For example, thestudy may include a series of images with varying degrees of contrast ora series of images without contrast. In one embodiment, each seriescomprises one or more images. For example, each series comprises one ormore images depicting the subject of the image from various angles. Inone embodiment, thumbnail images corresponding to each series associatedwith the healthcare study are displayed within the timeline. Thethumbnail images provide a high level view of the event associated withthe particular healthcare study. In one embodiment, the timelineincludes a thumbnail image associated with each series in the more thanone healthcare study. In one embodiment, the timeline includes athumbnail image associated with each image in the one or more series. Inone embodiment, the timeline is expandable and collapsible to display alevel of granularity corresponding to the more than one healthcare studyas desired by the clinician. For example, the clinician may desire tosee within the timeline all related healthcare studies, all series in aparticular study, or all images in a particular series. Or, theclinician may desire to see other information as defined herein. In suchscenarios, it may be desirable to expand the timeline to include suchitems. Or, the clinician may desire to see only a high level view of thetimeline and prefers to see the collapsed view, showing only selectedhealthcare studies. In one embodiment, the clinician may desire tofilter a particular image type (i.e., wound photos, dermatology, etc.)for the timeline.

A selection of at least one DICOM and at least one non-DICOM healthcareimage sourced from different sources is received, at step 820, from thetimeline. At step 830, a viewer for the selected healthcare images islaunched. The selected healthcare images are displayed, at step 840,side-by-side in the viewer and in a non-DICOM format. In one embodiment,a DICOM version of an image is retrieved if specialized tools are needed(i.e., measurement tools, window/leveling, etc.). For example, theclinician may desire to measure a particular item on a selected image.The JPEG version of the image may not have the resolution necessary forthe clinician to see or measure the particular item. In this instance,the resolution component retrieves the DICOM version of the image so theparticular item can be measured by the clinician.

In one embodiment, an indication from a clinician is received to includeother information in the timeline. The other information may includerelated healthcare studies or information associated with the healthcarestudies and images that may be relevant to the clinician. This otherinformation may also include non-image items such as procedure reports,healthcare related visits, and other information that may providecontext for the clinician to give the clinician a better understandingof the images provided in the viewer.

The present invention has been described in relation to particularembodiments, which are intended in all respects to illustrate ratherthan restrict. Alternative embodiments will become apparent to thoseskilled in the art that do not depart from its scope. Many alternativeembodiments exist, but are not included because of the nature of thisinvention. A skilled programmer may develop alternative means forimplementing the aforementioned improvements without departing from thescope of the present invention.

It will be understood that certain features and sub-combinations ofutility may be employed without reference to features andsub-combinations and are contemplated within the scope of the claims.Furthermore, the steps performed need not be performed in the orderdescribed.

The invention claimed is:
 1. One or more computer hardware storage media (the “media”) storing computer-useable instructions that, when executed by one or more computing devices, cause the one or more computing devices to perform a method for displaying a timeline corresponding to more than one healthcare study, the method comprising: presenting a timeline corresponding to more than one healthcare study for a patient; from the timeline, receiving a selection of at least one DICOM healthcare image and at least one non-DICOM healthcare image sourced from different sources, wherein a DICOM image adheres to a DICOM standard, which includes file format definition, includes network communications protocol, and groups the DICOM healthcare image with a patient identification and other DICOM healthcare images of the patient, and wherein the at least one DICOM healthcare image and the at least one non-DICOM healthcare image cannot be viewed in a same viewer; launching a viewer for the selected healthcare images; converting the at least one DICOM healthcare image to a Joint Photographic Experts Group (JPEG) format, wherein the JPEG format is a non-DICOM standard that does not follow the DICOM standard; displaying both at least one converted DICOM healthcare image and the at least one non-DICOM healthcare image selected from the timeline side-by-side in the viewer in a non-DICOM format; receiving input requiring a better resolution of the converted DICOM healthcare image; retrieving the DICOM healthcare image; and launching a separate DICOM viewer with specialty tools.
 2. The media of claim 1, wherein each study comprises one or more series.
 3. The media of claim 2, wherein each series comprises one or more images.
 4. The media of claim 3, wherein the timeline is expandable and collapsible to display a level of granularity corresponding to the more than one healthcare study as desired by a clinician.
 5. The media of claim 1, further comprising displaying within the timeline thumbnail images corresponding to an image associated with a healthcare study.
 6. The media of claim 2, wherein the timeline includes a thumbnail associated with each series in the more than one healthcare study.
 7. The media of claim 3, wherein the timeline includes a thumbnail associated with each image in the one or more series.
 8. The media of claim 1, further comprising receiving an indication from a clinician to include other information in the timeline.
 9. A computer system for displaying a timeline corresponding to more than one healthcare study, the computer system comprising a processor coupled to a computer storage medium, the computer storage medium having stored thereon a plurality of computer software components executable by the processor, the computer software components comprising: a timeline component for presenting a timeline corresponding to more than one healthcare study for a patient; a historical selection component for receiving, from the timeline, a selection of one or more DICOM healthcare images and one or more non-DICOM healthcare images from different sources, wherein a DICOM image adheres to a DICOM standard, which includes file format definition, includes network communications protocol, and groups the DICOM healthcare image with a patient identification and other DICOM healthcare images of the patient, and wherein the one or more DICOM healthcare images and the one or more non-DICOM healthcare images cannot be viewed in a same viewer; a historical viewer component for launching a viewer for the selected images; a conversion component for converting the one or more DICOM images to a non-DICOM format, wherein the non-DICOM format does not follow the DICOM standard; a historical display component for displaying both one or more converted DICOM healthcare images and one or more non-DICOM healthcare images side-by-side in the viewer in a non-DICOM format; and a resolution component for retrieving a DICOM version of a healthcare image previously converted from the DICOM format to the non-DICOM format if a better resolution is desired.
 10. The system of claim 9, further comprising a historical detail component for expanding and collapsing the timeline to display a level of granularity corresponding to the more than one healthcare study as desired by a clinician.
 11. The system of claim 9, further comprising a thumbnail component for displaying at least one thumbnail of an image corresponding to the more than one healthcare study of the timeline.
 12. The system of claim 9, further comprising a historical information component for including historical information in the timeline.
 13. The media of claim 1, wherein the source for at least one of the DICOM image and the non-DICOM image is received as a link from an EMR for the patient.
 14. The media of claim 1, further comprising determining a healthcare image type for the selected images.
 15. The media of claim 1, wherein the at least one non-DICOM image does not have DICOM wrapping.
 16. The media of claim 1, wherein the input requiring the better resolution comprises zooming in on an image, measuring an item in the image, or leveling the image.
 17. The media of claim 1, wherein the different sources include two or more databases from two or more facilities or locations.
 18. The media of claim 1, further comprising presenting an option to include non-image files on the timeline.
 19. The media of claim 1, wherein DICOM images are converted to JPEG format before displaying the timeline.
 20. The media of claim 1, further comprising filtering the timeline based on a particular image type. 